Skip to content

Conversation

@sakshimohan
Copy link
Collaborator

This PR updates the RF for consumable availability for level 1b facilities to reflect the merging of level 1b and 2 in simulations.

@sakshimohan
Copy link
Collaborator Author

sakshimohan commented Oct 30, 2025

Availability at level 1b is updated with average of availability (by item_code and month) for levels 1b and 2. Three strategies of weighting are adopted to test calibration -

  1. level2 – fully replace Level 1b availability with Level 2 values.

New RF :ResourceFile_Consumables_availability_small_level2.csv

  1. national_1b_to_2_ratio – apply a single national-level 1b:2 facility ratio for weighting.

New RF :ResourceFile_Consumables_availability_small_national_1b_to_2_ratio.csv

  1. district_1b_to_2_ratio – apply district-specific 1b:2 ratios for weighting.

New RF : ResourceFile_Consumables_availability_small_district_1b_to_2_ratio.csv

ResourceFile_Consumables_availability_small contains the original level 1b and 2 availability.

@sakshimohan
Copy link
Collaborator Author

Hi @tbhallett. As discussed earlier this week, I've added three new versions of the consumable availability RF on this branch to see how each of these performs in comparison with data.
The average availability by level in the 4 cases is as follows -

Level Actual level2 national_1b_to_2_ratio district_1b_to_2_ratio
0 0.22 0.22 0.22 0.22
1a 0.44 0.44 0.44 0.44
1b 0.58 0.70 0.61 0.63
2 0.70 0.70 0.70 0.70
3 0.79 0.79 0.79 0.79
4 0.38 0.38 0.38 0.38

@tbhallett
Copy link
Collaborator

tbhallett commented Nov 3, 2025

now running on Azure: long_run_all_diseases-2025-11-03T100729Z

@tamuri
Copy link
Collaborator

tamuri commented Nov 3, 2025

Errors with the workflow have been resolved - this PR's calibration workflow is now running!

@tbhallett
Copy link
Collaborator

@sakshimohan -- I've looked at the calibration runs for this, and nothing disastrous has happened -- so I think it's OK to proceed.

@sakshimohan
Copy link
Collaborator Author

@sakshimohan -- I've looked at the calibration runs for this, and nothing disastrous has happened -- so I think it's OK to proceed.

Many thanks, @tbhallett! I assume any of the four weighting options are OK? In this case, I'll use district_1b_to_2_ratio which weights availability by the ratio of 1b to 2 facilities within each district, because this feels most sound conceptually.

@tbhallett
Copy link
Collaborator

@sakshimohan -- I've looked at the calibration runs for this, and nothing disastrous has happened -- so I think it's OK to proceed.

Many thanks, @tbhallett! I assume any of the four weighting options are OK? In this case, I'll use district_1b_to_2_ratio which weights availability by the ratio of 1b to 2 facilities within each district, because this feels most sound conceptually.

Ok, that's fine to proceed then.

I also made this graph to help (me) remember the difference between that scenario and what's in master:

facility_scatter_plots

@sakshimohan
Copy link
Collaborator Author

sakshimohan commented Nov 10, 2025

@sakshimohan -- I've looked at the calibration runs for this, and nothing disastrous has happened -- so I think it's OK to proceed.

Many thanks, @tbhallett! I assume any of the four weighting options are OK? In this case, I'll use district_1b_to_2_ratio which weights availability by the ratio of 1b to 2 facilities within each district, because this feels most sound conceptually.

Ok, that's fine to proceed then.

I also made this graph to help (me) remember the difference between that scenario and what's in master:

This is really helpful. Just to note the reason that the availability is so vastly different for Salima, Ntchisi, Mwanza, Machinga, and Balaka (Facility IDs 2, 54, 70 102, 114) is that no facilities at level 1b were recorded in these districts as per HHFA. This means that the availability at level 1b is equated to that at level 2.
If we want to avoid this extreme case, I can just use the national_1b_to_2_ratio for the weighted average.

@tbhallett
Copy link
Collaborator

@sakshimohan -- I've looked at the calibration runs for this, and nothing disastrous has happened -- so I think it's OK to proceed.

Many thanks, @tbhallett! I assume any of the four weighting options are OK? In this case, I'll use district_1b_to_2_ratio which weights availability by the ratio of 1b to 2 facilities within each district, because this feels most sound conceptually.

Ok, that's fine to proceed then.
I also made this graph to help (me) remember the difference between that scenario and what's in master:

This is really helpful. Just to note the reason that the availability is so vastly different for Salima, Ntchisi, Mwanza, Machinga, and Balaka (Facility IDs 2, 54, 70 102, 114) is that no facilities at level 1b were recorded in these districts as per HHFA. This means that the availability at level 1b is equated to that at level 2. If we want to avoid this extreme case, I can just use the national_1b_to_2_ratio for the weighted average.

I see. I'd leave it to your best judgement on that then.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants